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(54) Robot failure diagnosing systems 





(57) A robot failure diagnosing system in which 
sound input by the user is interpreted/recognized by a 
command recognizing section in order to notify a re- 
quest for a diagnosis to a self-diagnosis section. For ex- 
ample, the user can input a command which prompts a 
self-diagnosis operation in the form of a natural commu- 
nication, such as by saying, "Perform a self-diagnosis 



operation," and by asking, "How do you feel, robot?" 
With respect to this, the robot can indicate the self-di- 
agnosis result in the form of a natural conversation, such 
as by saying, "I'm not feeling well," "My leg hurts," and 
"I'm hungry." The robot failure diagnosing system per- 
forms a self-diagnosis of a failure or abnormality in a 
system, and feeds back the diagnosis result to the user. 
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Description 

[0001] The present invention relates to robot failure 
diagnosing systems, such as those which may be incor- 
porated in a realistic robot which is constructed as a re- 
sult of modelling the operation and mechanism of a liv- 
ing body, such as a human being or a monkey. 
[0002] Even more particularly, the present invention 
relates to a leg-movement-type-robot controlling system 
which can independently perform an actuating opera- 
tion as a result of installing a controlling device thereat. 
Still more particularly, the present invention relates to a 
leg-movement-type robot controlling system which ex- 
ecutes a self -diagnosis of failures or abnormalities in the 
system, and which can feed back the diagnosis results 
to the user. 

[0003] The term robot is said to be derived from the 
Slavic word ROBOTA (slavish machine). In Japan, the 
use of robots began from the end of the 1 960s, many of 
which were industrial robots, such as manipulators and 
conveyance robots, used, for example, for the purpose 
of achieving automatic industrial operations in factories 
without humans in attendance. 
[0004] In recent years, progress has been made in the 
research and development of leg-movement-type ro- 
bots which emu late the movements and mechanisms of 
the body of an animal, such as a human being or a mon- 
key, which walks on two feet while in an erect posture, 
so that there is a higher expectation of putting them into 
practical use. The posture and walking of leg-movement 
types which walk on two feet while in an erect posture 
are more unstable than those of crawler types or types 
having four or six legs so that they are more difficult to 
control. However, they are excellent in that they can 
move and work flexibly. More specifically, leg-move- 
ment-type robots which walk on two feet are suited for 
walking along unleveled surfaces, working paths having 
obstacles, and floors having uneven surfaces, and walk- 
ing along walking surfaces which are not continuous, so 
that they can, for example, go up and down steps and 
ladders. 

[0005] Leg-movement-type robots which emulate the 
mechanisms and movements of living bodies are called 
humanoid robots. The significance of carrying out re- 
search and development on leg-movement-type robots 
which are called humanoid robots can be understood 
from, for example, the following two viewpoints. 
[0006] The first viewpoint is related to human science. 
More specifically, through the process of making a robot 
whose structure is similar to a structure having lower 
limbs and/or upper limbs of human beings/thinking up 
a method of controlling the same, and simulating the 
walking of a human being, the mechanism of the natural 
movement of a human being, such as walking, can be 
ergonomicaliy understood. The results of such research 
can considerably contribute to the development of other 
various research fields which treat human movement 
mechanisms, such as ergonomics, rehabilitation engi- 
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neering, and sports science. 

[0007] The other viewpoint is related to the develop- 
ment of robots as partners of human beings which help 
them in life, that is, help them in various human activities 

s in living environments and in various circumstances in 
everyday life. Functionally, in various aspects of the liv- 
ing environment of human beings, these robots need to 
be further developed by learning methods of adapting 
to environments and acting in accordance with human 

10 beings which have different personalities and charac- 
ters while being taught by human beings. Here, it is be- 
lieved that making the form and structure of a robot the 
same as those of a human being is effective for smooth 
communication between human beings and robots. 

15 [0008] For example, when teaching to a robot a way 
of passing through a room by avoiding obstacles which 
should not be stepped on, it is much easier for the user 
(worker) to teach it to a walking-on-two-feet-type robot 
which has the same form as the user than a crawler- 

20 type or a four-feet-type robot having structures which 
are completely different from the structure of the user. 
In this case, it must also be easier for the robot to learn 
it. (Refer to, for example, Controlling a Robot Which 
Walks On Two Feet" by Takanishi (Jidosha Gijutsukai 

25 Kanto Shibu <Koso> No. 25, April, 1 996.) 

[0009] The working space and living space of human 
beings are formed in accordance with the behavioral 
mode and the mechanism of the body of a human being 
which walks on two feet while in an upright posture. In 

30 other words, for moving present mechanical systems 
using wheels or other such driving devices as moving 
means, the living space of human beings has many ob- 
stacles. However, it is preferable that the movable range 
of the robot be about the same as that of human beings 

35 in order for the mechanical system, that is, the robot to 
carry out various human tasks in place of them orto help 
them carry out various human tasks, and to deeply pen- 
etrate the living space of human beings. This is the rea- 
son why there are great expectations for putting a leg- 

40 movement-type robot into practical use. In order to en- 
hance the affinity of the robot to the living environment 
of human beings, it is essential for the robot to possess 
a human form. 

[0010] One application of humanoid robots is to make 
45 them carry out various difficult operations, such as in 
industrial tasks or production work, in place of human 
beings. They carry out in place of human beings dan- 
gerous or difficult operations, such as maintenance 
work at nuclear power plants, thermal power plants, or 
50 petrochemical plants, parts transportation/assembly op- 
erations in manufacturing plants, cleaning of tall build- 
ings, and rescuing of people at places where there is a 
fire, and the like. 

[0011] Another application of the humanoid robot is 
55 related to the living together in the same living space as 
human beings, that is, to entertainment. In this type of 
application, the robot is deeply characterized as being 
closely connected to life rather than as helping human 
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beings in life by, for example, performing tasks in place 
of them. 

[0012] For entertainment robots, the production of an 
operation pattern, itself, which is executed during the 
operation is a theme regarding the research and devel- 
opment thereof rather than the constructing of them so 
that they can be industrially used as specified with high 
speed and high precision. In other words, it is preferable 
that the whole body harmoniously moving type opera- 
tion mechanism which an animal, such as human beings 
and monkeys, which walk on two feet while in an erect 
posture actually possess be faithfully reproduced in or- 
der to achieve smooth and natural movement. In addi- 
tion, in emulating highly intelligent animals, such as hu- 
man beings or monkeys, which stand in an upright pos- 
ture, it is to be considered that the use of an operation 
pattern which uses the four limbs is natural as a living 
body, and it is desirable that the movements are suffi- 
ciently indicative of emotions and feelings. 
[0013] Entertainment robots are required not only to 
faithfully execute a previously input operation pattern, 
but also to act vividly in response to the words and ac- 
tions of a person (such as speaking highly of someone, 
scolding someone, or hitting someone). In this sense, 
entertainment robots which emulate human beings are 
rightly called humanoid robots. 
[0014] In conventional toy machines, the relationship 
between the operations which are carried out by the us- 
er and the responding operation is fixed/standardized, 
so that the same operations are merely repeated, caus- 
ing the user to eventually get tired of the toy machines. 
In contrast, entertainment robots, though they execute 
operations in accordance with an operation generation 
time series model, can change this time series model, 
that is, impart a learning effect, in response to a detec- 
tion of an external stimulus which is produced by, for 
example, the operation of the user.. Therefore, the rela- 
tionship between the operations which are carried out 
by the user and the responding operation is program- 
mable, making it possible to provide an operation pat- 
tern which does not make the user tired of it or which 
conforms to the tastes of the user. In addition, by oper- 
ating the robot, the user can enjoy a type of educational 
simulation. 

[0015] The working space of a movable robot is not 
limited. The robot moves along a predetermined path or 
a pathless place in order to perform predetermined or 
any tasks in place of human beings or to provide various 
other services in place of human beings, dogs, or other 
living beings. 

[0016] So long as the movable robot is an industrial 
product, it must be provided with as little failures and 
abnormalities as possible to the user. However, it cannot 
be guaranteed that all of the products to be shipped will 
be free from abnormalities. In addition, by repeated use 
by the user, parts wear and deteriorate with the passage 
of time, so that failures inevitably occur in the products. 
Further, in a leg-movement-robot which is required to 



perform complicated posture control operations, abnor- 
mal processing of the system may be expected to occur 
during the repeated execution of thinking controlling and 
movement controlling operations, 
s [0017] When a failure or abnormality occurs in the 
product, the user needs to perform maintenance oper- 
ations, such as repairing operations. Here, it is conven- 
ient when an independently actuating type robot diag- 
noses the failure or tells the location of the failure to the 
10 user in response to a command which is given by the 
user or based on its own intention. In particular, the hu- 
manoid robot includes an excellent user interface which 
functions like a human being, so that one can expect the 
robot to receive a failure diagnosis command when the 
is user very naturally communicates with the robot, and to 
tell the diagnosis results to the user by a human-like ac- 
tion and in an easily understandable manner. 
[001 8] In the case of a movable robot, failures or ab- 
normalities in the system may cause secondary disas- 
20 ters such as the robot running into the user (or worker) 
when it moves wildly. Therefore, it is preferable that the 
robot independently tell the user at an early stage that 
a failure or an abnormality has occurred. 
[0019] It is an aim of at least an embodiment of the 
25 present invention to provide a controlling system for a 
leg-movement-type robot which can independently per- 
form an actuating operation as a result of installing a 
controlling device thereat. 

[0020] It is another aim to provide a controlling system 
so for a leg-movement-type robot which can perform a self- 
diagnosis operation of a failure or an abnormality in the 
system, and which can feed back the diagnosis results 
to the user. 

[0021] It is still another aim to provide a humanoid ro- 
ss bot which receives a failure diagnosis command through 
a "human-like" user interface, and which can tell the di- 
agnosis results in an easily understandable manner to 
the user. 

[0022] It is still another aim to provide a movable robot 
« which can independently tell at an early stage that a fail- 
ure or abnormality has occurred. 
[0023] According to the present invention, there is 
provided a robot failure diagnosing system which com- 
prises a plurality of joint actuators. The system further 
*s comprises request input means for inputting a request 
for a failure diagnosis thereto, measuring means for 
measuring the state of the inside of a robot, diagnosing 
means for diagnosing the failure of the robot in response 
to the request for a failure diagnosis which has been in- 
50 putto the request input means, and diagnosis result out- 
putting means for outputting a failure diagnosis result 
given by the diagnosing means to anything outside the 
system. 

[0024] In the robot failure diagnosing system, the re- 
's quest input means may receive the request through 
sound, or from an external system through a communi- 
cations interface. 

[0025] In the robot failure diagnosing system, the 
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measuring means may include an encoder for measur- 
ing the angle of each joint actuator, and the diagnosing 
means may diagnose the failure based on a deviation 
of each current joint angle output from the encoder from 
a corresponding target joint angle which is prescribed 
with respect to each joint actuator. 
[0026] In the robot failure diagnosing system, the 
measuring means may include a temperature sensor for 
measuring the temperature of the inside of each joint 
actuator, and the diagnosing means may determine that 
a failure has occurred in each joint actuator when each 
temperature measured by the temperature sensor ex- 
ceeds a corresponding prescribed value. 
[0027] In the robot failure diagnosing system, the ro- 
bot may be a battery-actuating-type robot. In this case, 
the measuring means may include a supply voltage de- 
tecting section for measuring a terminal voltage of a bat- 
tery or the supply voltage supplied to each section from 
the battery. In addition, the diagnosing means may de- 
termine that a power supply abnormality has occurred 
when the voltage detected by the supply voltage detect- 
ing section falls outside a corresponding prescribed val- 
ue. 

[0028] In the robot failure diagnosing system, the 
measuring means may include a posture sensorfor de- 
tecting the azimuthal angle of at least one of a pitch axis, 
a roll axis, and a yaw axis of the robot, and the diagnos- 
ing means may determine that an abnormal posture has 
occurred when the azimuthal angle detected by the pos- 
ture sensorfalls outside acorresponding prescribed val- 

[0029] In the robot failure diagnosing system, the 
measuring means may include an image input device, 
and the diagnosing means may perform a diagnosis 
based on a result which has been recognized from an 
input image which is provided at the image input means. 
[0030] In the robot failure diagnosing system, the 
measuring means may include an image input device, 
and the diagnosing means may perform a diagnosis 
based on a piece of object-related information which has 
been recognized from an input image which is provided 
at the image input means. 

[0031] In the robot failure diagnosing system, the 
measuring means may include an image input device, 
and the diagnosing means may perform a diagnosis 
based on a piece of color information which has been 
recognized from an input image which is provided at the 
image input means. 

[0032] In the robot failure diagnosing system, the 
measuring means may include at least one of a contact 
sensor and a power sensor, and the diagnosing means 
may determine that an abnormality has occurred when 
the output of either the contact sensor or the power sen- 
sor exceeds a prescribed value corresponding thereto. 
[0033] In the robot failure diagnosing system, the di- 
agnosis result outputting means may output the diagno- 
sis result using sound. 

[0034] In the robot failure diagnosing system, the di- 



agnosis result outputting means may output the diagno- 
sis result to an external system through a communica- 
tions interface. 

[0035] The robot embodying the present invention 

5 can perform a self-diagnosis operation of, for example, 
a failure or an abnormality in the system, and can feed 
back the diagnosis results to the user. 
[0036] The robot embodying the present invention 
can receive a request for a diagnosis by a sound input 

10 through a sound input device which corresponds to the 
sense of hearing of a human being, and express the di- 
agnosis results through a sound output. In other words, 
the robot receives a failure diagnosis command through 
a "human-like" user interface which it actually incorpo- 

15 rates, and tells about the diagnosis results in an easily 
understandable manner to the user. 
[0037] The invention will now be described by way of 
example with reference to the accompanying drawings, 
throughout which like parts are referred to by like refer- 

20 ences, and in which: 

[0038] Fig. 1 is a front view showing a leg-movement- 
type robot 100 of an embodiment of the present inven- 
tion. 

[0039] Fig. 2 is a back view of the leg-movement-type 
25 robot 1 00 of the embodiment of the present invention. 
[0040] Fig. 3 is a schematic view of a degree-of-f ree- 
dom structure model of the leg-movement-type robot 
100 of the embodiment of the present invention. 
[0041] Fig. 4 is a schematic view of the structure of a 
30 controlling system of the leg-movement-type robot 1 00 
of the embodiment of the present invention. 
[0042] Fig. 5 illustrates a state in which data is trans- 
ferred between a thinking controlling module 200 and a 
movement controlling module 300 in the leg-movement- 
35 type robot 1 00. 

[0043] Fig. 6 is a block diagram illustrating a self-di- 
agnosis function which the leg-movement-type robot 
1 00 possesses. 

[0044] Hereunder, a description of an embodiment of 
40 the present invention will be given in detail with refer- 
ence to the drawings. 

[0045] Figs. 1 and 2 are front and back views showing 
a humanoid leg-movement-type robot 1 00 of an embod- 
iment of the present invention standing in an upright po- 
45 sition. As shown in the figures, the leg-movement-type 
robot 100 comprises left and right lower limbs used for 
movement, a trunk, left and right upper limbs, and a 
head. 

[0046] The left and right lower limbs each comprise a 
so thigh, knee joint, a shin, an ankle, and a foot. They are 
connected to substantially the bottom end of the trunk 
by corresponding hip joints. The left and right upper 
limbs each comprise an upper arm, an elbow joint, and 
a front arm. They are connected to their corresponding 
55 upper left and right side edges of the trunk by corre- 
sponding shoulder joints. The head is connected to sub- 
stantially the uppermost end center portion of the trunk 
by a neck joint. 
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[0047] A control section (which cannot be seen in 
Figs. 1 and 2) is disposed in a trunk unit. The control 
section is a housing in which are installed a controller 
(a main controlling section) for controlling the actuation 
of each joint actuator making up the leg-movement-type 
robot 100 and for processing externally input informa- 
tion from, for example, each sensor (described later), 
and peripheral devices such as a power supply circuit.' 
The controlling section may also include a remote-con- 
trol communications interface or a communications de- 
vice. In the present invention, the place where the con- 
trolling section is disposed is not particularly limited. 
[0048] Fig. 3 schematically illustrates a joint structure 
of the leg-movement-type robot 1 00, which provides the 
degrees of freedom thereof. As shown in the figure, the 
leg-movement-type robot 100 comprises an upper part 
of the body including two arms and a head 1 , lower limbs 
or two legs used for movement, and a trunk which con- 
nects upper limbs and the lower limbs. 
[0049] A neck joint which supports the head 1 pos- 
sesses three degrees of freedom which are provided in 
correspondence with a neck joint yaw axis 2, a neck joint 
pitch axis 3, and a neck joint roll axis 4. 
[0050] Each arm includes a shoulder joint pitch axis 
8, a shoulder joint roll axis 9, an upper arm yaw axis 10, 
an elbow joint pitch axis 1 1 , a front arm yaw axis 12, a 
wrist joint pitch axis 13, a wrist joint roll axis 14, and a 
hand 15. Each hand 15 is actually a structure including 
a plurality of fingers so as to have many joints and de- 
grees of freedom. However, since the operation of each 
hand 15 itself rarely contributes to and influences the 
posture controlling and stable walking control opera- 
tions of the robot 100, each hand in the embodiment is 
assumed to possess zero degrees of freedom. There- 
fore, each left and right arm possesses seven degrees 
of freedom. 

[0051 ] The trunk possesses three degrees of freedom 
which are provided in correspondence with a trunkpitch 
axis 5, a trunk roll axis 6, and a trunk yaw axis 7. 
[0052] The left and right legs comprising the lower 
limbs each include a hip joint yaw axis 16, a hip joint 
pitch axis 1 7, a hip joint roll axis 18, a knee joint pitch 
axis 19, an ankle joint pitch axis 20, a joint roll axis 21, 
and a foot (or a sole) 22. The points where the hip joint 
pitch axes 1 7 and their corresponding hip joint roll axes 
1 8 intersect are defined as the locations of the hip joints 
of the robot 100 in the embodiment. The feet (or soles) 
of the human body are actually structures having many 
joints and degrees of freedom. However, the soles of 
the leg-movement-type robot 100 of the embodiment 
are assumed as having zero degrees of freedom. There- 
fore, each leg possesses six degrees of freedom. 
[0053] To sum up, the total number of degrees of free- 
dom of the leg-movement-type robot 100 of the embod- 
iment is 3 + 7x2 + 3 + 6x2 = 32. However, the number 
of degrees of freedom of the leg-movement-type robot 
100 is not necessarily limited to 32. It is obvious that the 
number of degrees of freedom, that is, the number of 



joints can be increased or decreased as necessary in 
accordance with, for example, the required specification 
and the limiting conditions in designing and manufactur- 
ing the robot. 

[0054] Each degree of freedom of the above-de- 
scribed leg-movement-type robot 1 00 is actually provid- 
ed using an actuator. To respond to the demands of ap- 
proximating the form of the robot to the natural form of 
a human being by removing extra bulges from its exter- 
io nal appearance, and of controlling the posture of an un- 
stable structure for walking on two feet, it is preferable 
to use small and light actuators. In the embodiment, 
there are used in the leg-movement-type robot 100 
small AC servo actuators which are directly connected 
'5 to gears and which incorporate in a motor unit a servo 
control system formed into a one-chip system. This type 
of AC servo actuator is disclosed in, for example, Jap- 
anese Patent Application No. 11-33386 which has al- 
ready been assigned to the applicant. 
20 [0055] Fig. 4 is a schematic view of the structure of a 
controlling system of the leg-movement-type robot 100 
of the embodiment of the present invention . In the figure, 
the system comprises a thinking controlling module 200 
which expresses and determines emotions and feelings 
25 by dynamically reacting to, for example, the input oper- 
ation performed bythe user, and a movement controlling 
module 300 for controlling the harmonious movement 
of the whole body of the robot by, for example, actuating 
a joint actuator. 
30 [0056] The thinking controlling module 200 is an in- 
formation processing device which can independently 
perform a self -completing operation and which compris- 
es a CPU (central processing unit) 211 for executing a 
computing operation regarding the expression and de- 
35 termination of feelings and emotions, RAM (random ac- 
cess memory) 21 2, ROM (read only memory) 213, and 
an external storage device (such as a hard disk drive) 
214. 

[0057] Through a bus interface 201 , various devices 
40 such as a communications interface 254 which ex- 
changes data with systems outside the robot 100 are 
connected to the thinking controlling module 200. The 
communications interface 254 performs the exchange 
of data through, for example, an image input device 251 
45 serving as a visual sensor such as a CCD (charge cou- 
pled device) camera, a sound input device 252 serving 
as a hearing sensor such as a microphone, a sound out- 
putting device 253 such as a speaker, and LAN (local 
area network) which is not shown. 
50 [0058] At the thinking controlling module 200, the 
present feelings and intentions of the leg-movement- 
type robot 100 are determined in accordance with, for 
example, outside stimulus, such as the input of visual 
data from the image input device 251 or the input of 
55 hearing data from the sound input device 252. In addi- 
tion, a command is issued to the movement controlling 
module 300 so that the robot acts, that is, moves using 
the four limbs, based on the decision made. 
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[0059] On the other hand, the movement controlling 
module 300 is a separate information processor for per- 
forming a self-completing operation. It comprises a CPU 
(central processing unit) 311 for controlling the harmo- 
nious movement of the whole body of the robot 100, 
RAM (random access memory) 312, ROM (read only 
memory) 313, and an external storage device (such as 
a hard disk drive) 314. 

[0060] Through a bus interface 301 , the movement 
controlling module 300 has connected thereto various 
devices such as joint actuators for providing degrees of 
freedom at the joints (see Fig. 3) which are spread 
throughout the whole body, a posture sensor 351 for 
measuring the posture and inclination of the trunk, floor 
contact confirmation sensors 352 and 353 for detecting 
the contacting of and moving off of the soles of the left 
foot and right foot with and from the floor, and a power 
supply controller for controlling the power supply such 
as battery used for actuation. 
[0061] The CPU 311 of the movement controlling 
module 300 controls the harmonious movement of the 
whole body by each of the joint actuators while realizing 
the action commanded by the thinking controlling mod- 
ule 200. 

[0062] In other words, the CPU 31 1 takes out an op- 
eration pattern in accordance with the action command- 
ed by the thinking controlling module 200 from the ex- 
ternal storage device 31 4 or internally generates an op- 
eration pattern. In accordance with the specified opera- 
tion pattern, the CPU 311 sets, for example, the move- 
ment of the feet, the path of the ZMP (zero moment 
point), the movement of the trunk, the movement of the 
upper limbs, the horizontal position and height of the 
waist, etc., and sends a command value for executing 
the operation pattern in accordance with the details of 
these settings to each of the joint actuators. 
[0063] By detecting the tilting and posture of the trunk 
of the robot 1 00 by the output signal of the posture sen- 
sor 351 and by detecting whether each movable leg is 
either in a "swinging state" or a "standing state" by an 
output signal of each of the floor contact confirmation 
sensors 352 and 353, the CPU 311 can appropriately 
control the harmonious movement of the whole body of 
the leg-movement-type robot 100. 
[0064] The movement controlling module 300 returns 
information concerning how far the robot has acted in 
accordance with the decision made at the thinking con- 
trolling module 200, that is, in accordance with the in- 
formation concerning the processing state, to the think- 
ing controlling module 200. 

[0065] The ZM P in the specification is the point on the 
floor surface where the moment resulting from the floor 
reaction force when the robot walks is zero. The ZMP 
path refers to the path of movement of the ZMP when, 
for example, the robot 100 is walking. 
[0066] The thinking controlling module 200 and the 
movement controlling module 300 are constructed on a 
common platform, and are connected together through 



the bus interfaces 201 and 301 . 
[0067] Fig. 5 illustrates a state in which data is trans- 
ferred between the thinking controlling module 200 and 
the movement controlling module 300 in the leg-move- 

s ment-type robot 1 00. 

[0068] The thinking controlling module 200 takes in 
image data as visual data which is acquired at the image 
input device 251 , and sound data as visual data which 
is input to the sound input device 252. In accordance 

10 with such stimuli from the outside, the present emotions 
and intentions of the leg-movement-type robot 1 00 are 
determined. 

[0069] In addition to making a decision in accordance 
with an external stimulus which is directly input to the 
'5 leg-movement-type robot 100, the thinking controlling 
module 200 can also determine the present emotions 
and intentions of the leg-movement-type robot 1 00 in 
accordance with data or a command transmitted from 
an external system through the communications inter- 
ne face254. Inthelattercase.auserataremoteplacecan 
supply data regarding, for example, the five senses and 
feelings to the robot 1 00 through a network or transmit 
a command to make it possible to prompt the robot 1 00 
to make a decision. 
25 [0070] Further, the operation pattern data used at the 
movement controlling module 300 can be downloaded 
inside the robot 100 through the communications inter- 
face 254 from a server (not shown) on the network. 
[0071] The thinking controlling module 200 issues a 
30 command to the movement controlling module 300 so 
that the action or conduct based on the decision making, 
that is, the movement using the four limbs is executed. 
From the movement controlling module 300, information 
regarding how farthe robot has acted in the commanded 
35 manner, that is, information regarding the processing 
state is returned. 

[0072] The thinking controlling module 200 not only 
prompts a movement controlling operation in accord- 
ance with the decision made by the module 200 itself, 

to but also can cause sound data which expresses the de- 
cision made and the emotions of the robot to be output 
from the sound outputting device 253. 
[0073] The thinking controlling module 200 further 
comprises a self-diagnosis function section. The self- 

45 diagnosis function section can determine whether or not 
an abnormality or failure has occurred at the movement 
controlling module 300 based on the details of the com- 
munication with the movement controlling module 300. 
More specifically, it determines that an abnormality has 

50 occurred when the following have occurred. 

(1) A processing state which has naming to do with 
the decision issued from the thinking module 200 is 
returned from the movement controlling module 

55 300. 

(2) The movement controlling module 300 does not 
return a processing state in accordance with the de- 
cision within a predetermined time from the issu- 
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ance of the decision. 

(3) The movement controlling module 300 returns 
a processing state which cannot be understood. 

[0074] At the movement controlling module 300, the 
harmonious movement of the whole body is controlled 
by actuating each of the joint actuators in synchronism 
with each other, while realizing the action commanded 
by the thinking controlling module 200. More specifical- 
ly, in accordance with the specified operation pattern, 
the movement of the legs, the ZMP (zero moment point) 
path, the movement of the trunk, the movement of the 
upper limbs, the horizontal position and height of the 
waist, etc., are set, and a command value for realizing 
the operation pattern in accordance with the details of 
the settings is sent to each of the joint actuators. 
[0075] From an encoder which is provided at each 
joint actuator, the rotational angle data of each joint is 
returned. As a result, the movement controlling module 
300 can know the actual displacement amount and dis- 
placement speed of each joint. In addition, by subjecting 
geometrical data concerning, for example, each joint 
displacement angle and each arm length to a predeter- 
mined geometrical computation, the pattern of the actu- 
al movement of the whole body of the leg-movement- 
type robot 1 00 can be computed. 
[0076] Detection signals from the posture sensor 351 
and the floor contact confirmation sensors 352 and 353 
for detecting the contacting of the left and right soles 
with the floor are input to the movement controlling mod- 
ule 300. Based on these detection signals and the actual 
operation pattern which has been calculated, the har- 
monious movement of the whole body of the leg-move- 
ment-type robot 100 can be appropriately controlled. 
[0077] Although not shown in Fig. 4, a power sensor 
355, a contact sensor 356, a temperature sensor 357, 
etc., maybe further disposed at predetermined portions 
of the leg-movement-type robot 100. The movement 
controlling module 300 can use sensation-of-power da- 
ta, tactile data, and temperature data taken in from these 
sensors in order to appropriately perform a controlling 
operation. 

[0078] The movement controlling module 300 further 
comprises a self-diagnosis function section. Based on 
the details of the communication with the thinking con- 
trolling module 200, the self-diagnosis function section 
can determine whether or not an abnormality or a failure 
has occurred at the thinking controlling module 200. 
More specifically, it determines that an abnormality has 
occurred when the following have occurred. 

(1 ) Decisions are received from the thinking control- 
ling module in an order which violates a predeter- 
mined state transition rule. 

(2) A decision which cannot be understood based 
on the predetermined state transition rule is given 
by the thinking controlling module. 



[0079] As shown in Fig. 5, hardware control signal 
lines such as a movement control module stop signal 
line and a thinking control module reset signal line are 
provided between the thinking controlling module 200 
5 and the movement controlling module 300. These con- 
trol signal lines are used when one of the controlling 
modules finds out that the other controlling module has 
carried out an abnormal operation. 
[0080] Fig. 6 illustrates a self-diagnosis function 
io which the leg-movement-type robot 1 00 of the embodi- 
ment possesses. 

[0081] A self-diagnosis section performs a self-diag- 
nosis operation of the condition of the inside of the robot 
100 independently or in response to a diagnosis request 

15 command from an external device as a result of moni- 
toring, for example, power supply data from a power 
supply controller 354 and detection output from each of 
the image input device (visual sensor) 251 , the encoder 
of each joint actuator, the posture sensor 351 , the floor 

so contact confirmation sensors 352 and 353, the power 
sensor355, and the contact sensor356. Thepowersup- 
ply controller 354 comprises a terminal voltage detect- 
ing section 354A for actuating a battery, and a detecting 
section 354B for detecting the remaining capacity of a 

25 battery. 

[0082] In the leg-movement-type robot 100 of the em- 
bodiment, the diagnosis request command is received 
by a sound input operation or from an external system 
(not shown) through a network. 

so [0083] In the former case, the sound which is input to 
the sound input device 252, such as a microphone, from 
the user is interpreted/recognized by a command rec- 
ognizing section in order to notify the self-diagnosis sec- 
tion that a request for a diagnosis has been made. For 

3s example, the user can input to the robot 1 00 commands 
which prompt a self-diagnosis operation in the form of 
a natural communication, such as by saying, "Perform 
a self-diagnosis operation," or by asking "How do you 
feel, robot?" 

to [0084] In the latter case, after a command which is 
sent from an external system through a network has 
been received by the communications interface 254 
once, the command is interpreted/recognized by the 
command recognizing section in order to notify the self- 

45 diagnosis section that a request for a diagnosis has 
been made. The external system (not shown) on the net- 
work may provide a GUI (graphical user interface) 
screen used for operating the robot. 
[0085] In the leg-movement-type robot 1 00 of the em- 

50 bodiment, the results of the self-diagnosis operation de- 
termined by the self -diagnosis section can be indicated/ 
told to the external system, that is, the user. As a result, 
the user can, for example, perform operations (such as 
maintenance on the robot 100) based on the diagnosis 

55 results. 

[0086] The self-diagnosis results can be indicated or 
told by a sound output operation or by transmission to 
the external system through the network. 
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[0087] In the former case, atan indication control sec- 
tion, sound data which indicates the diagnosis results is 
generated in order to output sound from the sound out- 
putting device 253, such as a speaker, in order to tell/ 
indicate the diagnosis results to the user. The self-diag- 
nosis results can be indicated in the form of a natural 
conversation, such as by saying "I'm not feeling well," 
"My leg hurts," and "I'm hungry." 
[0088] In the latter case, at the indication control sec- 
tion, a data frame (or packet) in which the diagnosis re- 
sults are given is generated, and is sent to the external 
system on the network through the communications in- 
terface 254. The external system (not shown) on the net- 
work may respond to the reception of the diagnosis re- 
sults in orderto cause a pop-up window which indicates 
the details of the diagnosis to appear or in order to gen- 
erate a warning sound. 

[0089] When, forexample, an abnormality is detected 
at the thinking controlling module 200 as a result of the 
diagnosis at the self-diagnosis section, the movement 
controlling module 300 switches to the safest state or 
"stopping at astanding state" in orderto preventthe pos- 
sibility of the further execution wild operations as a result 
of receiving an erroneous decision again. In addition, 
the movement controlling module 300 enables the reset 
signal of the thinking controlling module 200 in orderto 
reset the thinking controlling module 200. The move- 
ment controlling module 300 waits until the thinking con- 
trolling module 200 starts operating again and is re- 
stored to the normal operation state. 
[0090] When an abnormality is detected at the move- 
ment controlling module 300 as a result of the diagnosis 
at the self-diagnosis section, the thinking controlling 
module 200 enables the stop signal of the movement 
controlling module 300 in order to stop the movement 
controlling module 300. As a result, it is possible to pre- 
viously prevent, for example, fire caused when an actu- 
ating system, such as a joint actuator, operates wildly 
due to continued abnormal operations. 
[0091] An example of the self-diagnosis function 
which is executed at the self -diagnosis section will now 
be described. 

(1) Joint angle 

[0092] With respect to a target joint angle command 
given to each joint actuator, each piece of current posi- 
tional information, that is, each joint angle which is fed 
back from each encoder after positioning by actuation 
is confirmed in order to record the deviation from each 
target joint angle. If the deviation exceeds a prescribed 
amount, a failure diagnosis result indicating "abnormal 
positioning" is issued. 

(2) Measurement of temperature 

[0093] A temperature sensor 357 is installed in each 
joint actuator (or some of the joint actuators which are 



moved with a high percentage) in order to measure the 
temperature of the inside of each actuator. Each piece 
of temperature data is periodically monitored and each 
value thereof is sequentially recorded. When the tem- 
s perature exceeds a corresponding prescribed value (or 
when an unnatural temperature change occurs), a fail- 
ure diagnosis result indicating "abnormal temperature" 
is issued. 

io (3) Supply voltage 

[0094] The power supply controller354 monitors at all 
times the supply voltage of the battery used for actuation 
and the supply voltage applied to each of the controlling 

is modules 200 and 300 and each of the joint actuators, 
and sequentially records the measured values. When a 
supply voltage greatly exceeds a corresponding pre- 
scribed value, a failure diagnosis result indicating "ab- 
normal supply voltage" is issued. 

20 [0095] When the supply voltage is less than the cor- 
responding prescribed value, the remaining capacity of 
the battery may be low (that is, the battery may be in a 
discharged state). When the supply voltage exceeds the 
corresponding prescribed value, a wild operation or a 

25 controlling circuit failure may occur. 

(4) Communications control 

[0096] Each joint actuator used in the embodiment is 
30 a small AC servo actuator which is directly connected 
to gears and which incorporates in a motor unit a servo 
control system formed into a one-chip system (men- 
tioned above). The servo control system of each actua- 
tor performs communications with the higher-level 
35 movement controlling module 300 in order to receive 
each actuation command value and to send the output 
of each encoder. 

[0097] The movement controlling module 300 always 
monitors the details of the communications with each 
40 joint actuator, and issues a failure diagnosis result indi- 
cating "abnormal joint" when it detects an abnormality. 

(5) Posture 

45 [0098] The output from the posture sensor 351 which 
is installed at the trunk of the leg-movement-type robot 
1 00 makes it possible to measure the azimuthal angle 
of each of the pitch axis, the roll axis, and the yaw axis. 
[0099] In the case where the azimuthal angle of at 

so least the pitch axis, the roll axis, and the yaw axis falls 
outside a prescribed value while the robot is walking nor- 
mally, a failure diagnosis result indicating "abnormal 
posture" is issued. 

[0100] Even in the case where operations other than 
55 normal walking are being executed, when the azimuthal 
angle of the pitch axis, the roll axis, or the yaw axis falls 
outside its corresponding prescribed value with respect 
to the commanded movement posture, a failure diagno- 
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sis result indicating "abnormal posture" is issued. 
[01 01 ] The self-diagnosis section may detect failures 
or abnormalities based on the output of the image input 
device 251 , the power sensor 355, or the contact sensor 
356. 

[01 02] For example, using the image input device 251 
as a visual sensor, it is possible to perform a diagnosis 
based on a piece of object-related information (such as 
the form, contour, and edges of the object) and the in- 
formation of the color of the object which have been rec- 
ognized from the input image. 

[0103] When the output of either the contact sensor 
or the power sensor exceeds its corresponding pre- 
scribed value, it can, for example, determine that an ex- 
ternal force has been applied, and, thus, that an abnor- is 
mality has occurred. 

[Supplement] 

[0104] The present invention has been described in 20 
detail with reference to a particular embodiment. How- 
ever, it is obvious that modifications and substitutions 
may be made by thoseskilled in the art without departing 
from the gist of the present invention. In other words, 
the present invention has been described in various 2s 
forms for illustrative purposes only. Therefore, it is to be 
understood that the present invention is not limited 
thereto. In order to determine the gist of the present in- 
vention, one should refer to the claims. 
[0105] As described in detail above, it is possible to 30 
provide an excellent controlling system of a leg-move- 
ment-type robot which can independently perform an 
actuating operation as a result of installing a controlling 
device thereat, which can perform a self-diagnosis op- 
eration of a failure or an abnormality in the system, and 35 
which can feed back the diagnosis results to the user. 
[0106] It is also possible to provide a humanoid robot 
which receives a failure diagnosis command through an 
excellent, "human-like" user interface, which can tell the 
diagnosis results in an easily understandable mannerto 40 
the user, and which can independently tell at an early 
stage that a failure or abnormality has occurred. 
[0107] In so far as the embodiments of the invention 
described above are implemented, at least in part, using 
software-controlled data processing apparatus, it will be 45 
appreciated that a computer program providing such 
software control and a storage medium by which such 
a computer program is stored are envisaged as aspects 
of the present invention. 



a failure diagnosis thereto; 

measuring means for measuring the state of 

the inside of a robot; 

diagnosing means for diagnosing the failure of 
the robot in response to the request for a failure 
diagnosis which has been input to the request 
input means; and 

diagnosis result outputting means for output- 
ting a failure diagnosis result given by the diag- 
nosing means to anything outside the system. 

2. A robot failure diagnosing system according to 
Claim 1 , wherein the request input means receives 
the request through sound. 

3. A robot failure diagnosing system according to 
Claim 1 , wherein the request input means receives 
the req uest from an external system through a com- 
munications interface. 

4. A robot failure diagnosing system according to 
Claim 1 , wherein the measuring means includes an 
encoder for measuring the angle of each joint actu- 
ator; and wherein the diagnosing means diagnoses 
the failure based on a deviation of each current joint 
angle output from the encoder from a correspond- 
ing target joint angle which is prescribed with re- 
spect to each joint actuator. 

5. A robot failure diagnosing system according to 
Claim 1 , wherein the measuring means includes a 
temperature sensor for measuring the temperature 
of the inside of each joint actuator, and wherein the 
diagnosing means determines that a failure has oc- 
curred in each joint actuator when each tempera- 
ture measured by the temperature sensor exceeds 
a corresponding prescribed value. 

6. A robot failure diagnosing system according to 
Claim 1, wherein the robot is a battery-actuating- 
type robot, wherein the measuring means includes 
a supply voltage detecting section for measuring a 
terminal voltage of a battery or the supply voltage 
supplied to each section from the battery, and 
wherein the diagnosing means determines that a 
power supply abnormality has occurred when the 
voltage detected by the supply voltage detecting 
section falls outside a corresponding prescribed 
value. 



Claims 

1. A robot failure diagnosing system which comprises 
a plurality of joint actuators, the system further com- 
prising: 

request input means for inputting a request for 



7. A robot failure diagnosing system according to 
Claim 1 , wherein the measuring means includes a 
posture sensor for detecting the azimuthal angle of 
at least one of a pitch axis, a roll axis, and a yaw 
axis of the robot, and wherein the diagnosing 
means determines that an abnormal posture has 
occurred when the azimuthal angle detected by the 
posture sensor falls outside a corresponding pre- 
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scribed value. 

8. A robot failure diagnosing system according to 
Claim 1 , wherein the measuring means includes an 
image input device, and wherein the diagnosing s 
means performs a diagnosis based on a result 
which has been recognized from an input image 
which is provided at the image input means. 

9. A robot failure diagnosing system according to 10 
Claim 1 , wherein the measuring means includes an 
image input device, and wherein the diagnosing 
means performs a diagnosis based on a piece of 
object-related information which has been recog- 
nized from an input image which is provided at the 15 
image input means. 

10. A robot failure diagnosing system according to 
Claim 1 , wherein the measuring means includes an 
image input device, and wherein the diagnosing 20 
means performs a diagnosis based on a piece of 
color information which has been recognized from 

an input image which is provided at the image input 
means. 

25 

11. A robot failure diagnosing system according to 
Claim 1 , wherein the measuring means includes at 
least one of a contact sensor and a power sensor, 
and wherein the diagnosing means determines that 

an abnormality has occurred when the output of ei- 30 
ther the contact sensor or the power sensor ex- 
ceeds a prescribed value corresponding thereto. 

12. A robot failure diagnosing system according to 
Claim 1, wherein the diagnosis result outputting 35 
means outputs the diagnosis result using sound. 

13. A robot failure diagnosing system according to 
Claim 1 , wherein the diagnosis result outputting 
means outputs the diagnosis result to an external -*o 
system through a communications interface. 
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FIG. 4 
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FIG. 5 
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